Skip to content

ch: Distributed Table Engine#2997

Merged
serprex merged 47 commits into
mainfrom
distributed-table-engine
Jul 3, 2025
Merged

ch: Distributed Table Engine#2997
serprex merged 47 commits into
mainfrom
distributed-table-engine

Conversation

@serprex

@serprex serprex commented Jun 2, 2025

Copy link
Copy Markdown
Member

useful in conjunction with Replicated table engines

Replication is no longer stored on table mapping. Instead, peer has replicated/distributed bools. Replicated will use Replicated table engines. Specifying cluster name will adjust DDL to use ON CLUSTER & put raw tables / destination tables behind Distributed table engine

There seems to be some issues with updates/deletes despite using parallel_distributed_insert_select=2. But for append only use case this seems to work. Adjusting raw table's sharding key to match destination table's sharding key seems to alleviate this issue

@serprex serprex requested a review from iskakaushik June 2, 2025 22:37
@serprex serprex force-pushed the distributed-table-engine branch 26 times, most recently from c087ec3 to 6400f05 Compare June 9, 2025 18:50
@serprex serprex force-pushed the distributed-table-engine branch 3 times, most recently from d5d550e to a1a1db1 Compare June 16, 2025 19:42
@serprex serprex force-pushed the distributed-table-engine branch from f475854 to 87bbb1c Compare July 3, 2025 06:04
@serprex serprex merged commit bd33001 into main Jul 3, 2025
23 of 27 checks passed
@serprex serprex deleted the distributed-table-engine branch July 3, 2025 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants